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CROSS-REFERENCE TO RELATED APPLICATION(S) 
5 This application claims priority from provisional application Serial No. 

60/414,803 filed on September 30, 2002, entitled "A NEW ITERATIVE 
DECODING OF REED-MULLER CODES." 



BACKGROUND OF THE INVENTION 

10 This invention is concerned with the decoding of the information bearing 

sequences, which occur in modem digital communication systems. In 
particular, the present invention is concerned with a system and method for 
decoding information bearing sequences received from an intersymbol- 
interference communication channel, from a noisy communication channel, or 

1 5 from recording devices. 

In modem communication and recording systems, information symbols 
in neighboring data tracks on a disc or adjacent bits in a transmission sequence 
sometimes interfere with each other during the transmission through the 
channel. In this case, the term "channel" refers to the medium from which the 

20 information symbols are received. This interference is known as "intersymbol 
interference" (ISI), and ISI impairs the performance of a communication system. 

While the elimination of ISI would be optimal, in many systems, ISI 
cannot be completely eliminated. However, steps can be taken to reduce the 
effect of ISI on the error rate of information transmissions. 

25 One way of reducing the effect of ISI is to equahze the channel's 

impulse response to a pre-defined transfer function. The pre-defined transfer 
function does not eliminate ISI. Instead, using the known intersymbol 
interference, the receiver can reduce the effect of ISI by using a proper decoding 
algorithm. This method of communication is referred to as partial-response 

30 (PR) signaling. A general description of PR signaling is given by P. Kabel et 
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al, in the paper "Partial Response Signaling," JEE Transaction on 
communications. Vol. COM-23, No. 9, September 1975, pp 921-934. 
Generally, partial-response signaling allows for better handling of the 
intersymbol interference and for more efficient utilization of the bandwidth of a 
5 given channel. 

Maximum-likelihood sequence detection (MLSD), in particular the 
Viterbi algorithm (VA), is a method for the detection of the sequences in the 
presence of intersymbol interference. A general description of this technique 
was provided by G.D. Forney in "The Viterbi Algorithm," published in the 

10 proceedings of the IEEE, Vol. 61, No. 3, March 1973, pp. 268-278, and by G. 
Ungerboeck, "Adaptive Maximum-likelihood Receiver for Carrier-modulated 
Data Transmission Systems," in the IEEE Transactions on Communications, 
Vol. COM-22, No. 5, May 1974, pp, 624-636. The Viterbi Algorithm currently 
is used in many communication and recording systems. 

15 The Soft-Output Viterbi Algorithm (SOVA) is a modification of the VA 

that gives the most likely path sequence in the trellis, as well as the a posteriori 
probability for each transmitted bit. A general description of the SOVA 
technique was described by J. Hagenauer and P. Hoeher in the article "A Viterbi 
algorithm with soft decision outputs and its applications," in the Proc. 

20 GLOBECOM'89, pp. 1680-1686. Optimal a posteriori probabilities are also 
given by the so-called BCJR algorithm. A general description of the BCJR 
algorithm was provided in the article authored by L. Bahl, J. Cocke, F. Jelinek, 
and J. Raviv, entitled "Optimal decoding of linear codes for minimizing symbol 
error rate," IEEE Trans.on Information Theory, pp. 284-287, March 1974. Both 

25 the Viterbi and the BCJR algorithms, when combined with a soft decoding 
scheme for convolution modulation codes, form efficient iterative "turbo" 
decoding schemes. Both the SOVA and the BCJR algorithm can be used in the 
partial response (PR) channels. 

Although the bit-error rate (BER) of the turbo algorithm approach 

30 Shannon's theoretical limit, the complexity of their implementation and the time 
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delays introduced by these algorithms through the decoding process pose serious 
problems for real-time information retrieval. 

One potential solution to this problem involves low-density parity-check 
(LDPC) codes. LDPC codes have orthogonal parity checks on all message bits, 
5 which allows a message bit to be determined by majority voting at a single 
decoding step. LDPC codes belong to a class of codes referred to as "one step 
majority decodable codes", which are discussed in a book authored by S. Lin 
and D. J. Costello. Jr. entitled "Error control coding: fundamentals and 
applications", and published by Prentice Hall in 1983. 

10 Generally, one step majority decodable codes support message-passing 

decoding, an iterative decoding algorithm on a code graph. "Messages" are 
descriptions of local function products (possibly marginahzed local function 
products). The functions are "local" in the sense that access to the functions is 
local to a specific vertex in the graph. Knowledge of local functions (or 

15 functions derived firom local functions such as probabilities) can be propagated 
to non-local vertices by "message passing" along the edge of the graph. 
Essentially, messages are passed between the vertices of the "propagation tree". 

While one step majority decodable codes work for some applications, it 
is known that it is not possible to construct short and powerful LDPC codes that, 

20 at the same time, have a high code rate. The high rate LDPC codes capable of 
correcting burst and ISI errors are long. However, long codes result in coding 
delays, which may not be tolerable in practical applications. In particular, coding 
delays in magnetic recording would be intolerable. The code rate is very 
important in magnetic recording because low code rates amplify the signal-to- 

25 noise ratio (SNR) loss. The issues related to the code rate loss in baseband 
communication and recording channels are well known. 

Therefore, it is desirable to have a coding system that offers high coding 
rates with shorter codes; and it is desirable to have a Turbo decoder capable of 
decoding the shorter codes at a high code rate. 
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BRIEF SUMMARY OF THE INVENTION 
In the present invention, Reed-Muller coded information is decoded by 
extracting log-bit reliabilities from information received from a partial-response 
or noisy channel. The log-bit reliabilities are decoded by a Reed-Muller 

5 message passing algorithm. The decoded bit reliabilities are then assembled into 
a code reliability, interleaved and reprocessed with the originally received data 
to iteratively perfect the log-bit reliability vector before outputting the decoded 
information. 

A system for decoding Reed-Muller coded information includes a first 

10 soft-output device for processing a coded signal and for producing code bit 
decisions and code bit reliabilities based on the coded signal. The system also 
includes a first Reed-Muller message passing device for decoding the code bit 
decisions and decoding the code bit reliabiUties into an information bit decision 
and an information bit reliability vector. 

15 The decoding system has an assembler for combining the message bit 

reliabilities into a code word reliability vector for use in a second soft-output 
device, wherein each element of the code word reliability vector is a code bit 
reliability number. 

The system has an assembler for combining the message bit reliabilities 

20 into a reliability vector and a second soft-input device for processing the coded 
signal based on the code word reliability vector. The second soft-input device 
also produces updated code bit decisions and updates code bit reliabilities based 
on the coded signal and the code word reliability vector. A second Reed-Muller 
message passing device processes the updated code bit decisions and updated 

25 code bit reliabilities into an updated information bit decision and an updated 
information bit reliability vector. 

In one embodiment, the coded signal processed by the system is an 
interleaved coded signal and a de-interleaver is positioned between the soft- 
output device and the Reed Muller message passing device for recovering an 

30 original sequence of coded information from a received sequence. 
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In another embodiment, the Reed-MuUer message passing decoder uses 
log bit reliabilities to evaluate the coded signal. 

In one embodiment, a method for decoding of a Reed-Muller code 
includes the steps of generating a code bit vector and a log-bit probabihty vector 
5 based on a received coded signal using a first soft-output device; passing at least 
the log-bit probability vector to a second soft-output device; and generating an 
updated code bit vector and an updated log-bit probability vector based on the 
received coded signal and at least the log-bit probability vector. 

In some instances, the step of generating a code bit vector involves 
10 decoding the received coded signal using a soft-output device to produce the 
code bit vector and a bit reliability vector. The code bit vector and the bit 
reliability vector is decoded into a Reed-MuIler de-coded information bit vector 
and an information bit reliability vector. Finally, the information bit reliability 
vector is decoded into a code word reliability vector. 
15 In one embodiment, the coded signal is an interleaved signal, and the 

method involves a step of de-interleaving the code bit vector and the bit 
reliability vector. 

Between iterations of the decoder loop, the system includes the step of 
interleaving at least the codeword reliability for use in a next soft-output device. 

20 Reed-Muller decoding the updated code bit vector and an updated log-bit 
probability vector. The code bit reUability vector is a log-bit-likelihood. 

In one embodiment, a soft iterative decoding system has two or more 
decoding blocks for processing coded information into a decoded bit vector and 
a decoded probability vector. Each decoding block has a soft-output device for 

25 processing the coded information according to a code word probability vector 
into a code bit information vector and an associated code bit reliability vector. 
Each decoding block also has a Reed-Muller device for decoding the code bit 
information vector and the associated code bit rehability vector. An assembler 
device between each decoding block processes the code bit information vector 
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and the associated code bit reliability vector received from a previous decoding 
block into a codeword vector and an associated codeword reliability vector for a 
next decoding block. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a graph of the codeword length versus the code rate for Reed- 
Muller codes. 

FIG. 2 is a graph of the codeword length versus code rate for 
deterministic LDPC codes. 
10 FIG. 3 is block diagram of a communication/recording system 

employing Reed-Muller coding. 

FIG. 4 is a block diagram of a Reed-Muller Partial-Response decoder 
according to the present invention. 

FIG. 5 illustrates data flow in a soft (2,4) Reed-Muller decoder. 
15 FIG. 6 is a graph of the bit-error rate versus the signal to noise ratio of 

Reed-Muller codes with dmin=8 and an ideal EPR4ML channel having an 
impulse response of {+1 +1 -1 -1}. 

FIG. 7 is a graph of the bit-error rate versus the signal to noise ratio of 
Reed-Muller codes with dni,n=16 and an ideal EPR4ML channel having an 
20 impulse response of {+1 +1 -1 -1}. 

FIG. 8 is a graph of the bit-error rate versus the signal to noise ratio of 
Reed-Muller codes with dmin=8 and an ideal PR2ML charmel with an impulse 
response of {12 1}. 

FIG. 9 is a graph of the bit-error rate versus the signal to noise ratio of 
25 Reed-Muller codes with dmin=16 and an ideal PR2ML channel having an 
impulse response of {12 1}. 

FIG. 10 is a graph of the bit-error rate versus the signal to noise ratio of 
Reed-Muller codes with no interleaver and an ideal PR2 charmel. 
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FIG. 1 1 is a graph of the bit-error rate versus the signal to noise ratio of a 
Reed-Muller (3,7) code and an ideal partial-response (2) channel for 10 
iterations from 1 to 10. 

FIG. 12 is a graph of the bit-error rate versus the signal to noise ratio of 
5 high rate Reed-Muller codes with dmin=4 and an ideal EPR4 channel. 

FIG. 13 is a graph of the bit-error rate versus the signal to noise ratio of 
high rate Reed-Muller codes with dmin=4 and an ideal PR2 channel. 

FIG. 14 is a graph of the bit-error rate versus the signal to noise ratio of 
RM(4,7) code and random LDPC code with the same code rate and codeword 
10 length. 

FIG. 15 is a graph of the bit-error rate versus the signal to noise ratio of 
RM(5,7) code and random LDPC code with the same code rate and codeword 
length. 

15 DETAILED DESCRIPTION 

Generally, Reed-Muller (RM) codes belong to a subset of codes known 

as "finite geometry codes", in which the null space of the code is defined by the 

points on a set of hyper-planes in a vector space. When the vector space on 

which the hyper-planes are defined is based on a binary field (field of the space 
20 is GF(2)), the codes are referred to as "Reed-Muller codes." RM-codes are 

linear cyclic codes that are multi-step majority logic decodable and that do not 

have orthogonal parity checks. 

Generally, the vector space consists of strings of length 2^ consisting of 

numbers within a defined set (such as {0,1} or {-1,0,1} and the like), where m is 
25 a positive integer. The codewords of a Reed-Muller code fomi a subspace of 

such a vector space. 

An i^^ orderReed-MulIer code 9t(i,m) is a set of all binary strings 

(vectors) of length n=2"^ associated with Boolean polynominals p(xi, X2, ... Xm). 

The 0^^ order Reed-Muller code 3l(0,m) consists of binary strings associated 
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with either 0 or 1, such that 9l(0,m) is a repetition of either zeros or ones of 
length 2"^. 

Typically, to define an encoding matrix of Sl(i,m), the first row of the 
encoding matrix is set to 1, such that the first row defines a vector of length 2^ 
5 with all matrix entries in that row equal to 1 . If "i" is equal to zero, then this 
row is the only row in the encoding matrix. If "i" is equal to one, then add m 
rows (xi, X2, ... Xm) corresponding to the vectors xi, X2, ... Xm to the 9l(i,m) 
matrix. Finally, if i is greater than 1 , then we add an additional number of rows 
n corresponding to the "m-choose-i" function, such that 

10 

m\ 
i\{m-i)\ 

Thus, a number of rows (n) are added corresponding to the number of ways of 
selecting i different objects from a set of (m) objects. An example of an RM 
15 code generator matrix 9t(2,4) is provided below. For the matrix operations, 
addition is modulo-2 addition and multiplication steps are logical AND 
operations. 

As discussed above, the first row of the generator matrix is comprised of 
vector of I's. 

20 

Go=[llllllllllllllll] = [ao] 

The next four (m=4) rows are constructed from the binary 
representations of the integers from 0 to 15 (16 bits corresponding to 2^). The 
25 binary representations are arranged vertically in increasing order from left to 
right in the Gi matrix below. 
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Finally, the m-choose-i rows of the matrix are constructed from the Gi 
matrix. The 4-choose-2 operation results in six possible permutations (therefore 
5 six rows). For a Reed-Muller (2,4) encoder (hereinafter referred to as an 
"RM(2,4)" encoder or decoder), we first choose, for example, the first two rows 
from the Gi matrix and perform a bit-wise logical AND operation to form the 
following matrix rows indicated by matrix G2 below. 
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There is no specific order of preference to ordering the rows of the generator 
matrix of G2. Moreover, this example is provided for illustration purposes only. 
In general, the generator matrix G of RM (2,4) code will have k rows and 
15 n columns, where n is the code word length (2"™) and k is defined as follows. 




20 

Thus, the Generator matrix G for the RM(2,4) code is an 11x16 matrix 
constructed from Go, Gj, and G2, which appears as follows. 
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For example, using 
9?(2,4) to encode 

m=(01 100000) gives 

0*(inilllllllll 

ni)+i*(ooooooooiiiiii 

11)+1*(000011110000111 
1)+0*(001100U001 10011 
)+0*(0101010101010101) 
+0*(0000000000001111)+0*(0000000000110011)+0*(0000000001010101)=(0 
000111111110000). 

The rate (R) of the code can be found by dividing the number of rows by the 
number of columns (R=k/n). The minimum Hamming distance of the code can 
be shown to be dmin =2^^'^\ This minimum Hamming distance is much less than 
that of the Bose-Chaudhuri-Hochquenghem code (BCH code) with the 
codeword length n is large. The BCH code is a muhilevel, cyclic, error- 
correcting, variable-length digital code used to correct errors up to 
approximately 25% of the total number of digits. It is important to note that 
BCH codes are not limited to binary codes, but may be used with multilevel 
phase-shifting keying whenever the number of levels is a prime number or a 
power of a prime nximber, such as 2, 3, 4, 5, 7, 8, 11, and 13. A BCH code in 1 1 
levels has been used to represent the 10 decimal digits plus a sign digit. 
However, RM codes may not perform as well as the BCH codes if the RM codes 
are decoded using the conventional hard coding algorithm. Generally, decoding 
Reed-MuUer encoded messages is more complex than encoding them. The 
theory behind decoding a Reed-MuUer encoded message is based on the 
distance between vectors. The distance between any two vectors is the number 
of places in the two vectors that have different values. The distance between 
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any two codewords in SR(i,m) is 2^^'^\ Reed-MuUer coding is based on the 
assumption that the closest codeword in 9l(i,m) to the received message is the 
original encoded message. For any error (e) to be corrected in the received 
message, the distance between any two received codewords must be greater than 

5 2*(e). For the encoded message described above, the distance in 5R(2,4) is 2^^'^\ 
or 4, which means that the code can fix 2e<4 (in other words, the decoder can 
fix errors within a distance of 1). 

Generally, the decoding process for a 91(2,4) code is known to workers 
skilled in the art, and is too involved to explain in detail herein. However, it is 

10 important to understand that, within the above-mentioned limits, any errors in 
the received encoded codeword can be overcome during the decoding process 
via majority voting. For example, the codeword in 91(2,4) can be expressed as a 
sum of codewords (c) as follows: 
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C=MG, where M=[MoMiM2] and where 

'Go] 

G = 

G2 



Decoding of the message M begins by decoding M2 and then proceeds to the 
decoding of Mi and Mo as is known by a worker skilled in the art. 
20 For example, decoding of M2~{ms,. . .mjo) leads to the following 

expressions: 
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cl2 




mo + mi + m2 + m5 


cl3 




mo + mi + m2 + m4 + ms + m? + m9 


cl4 
cl5 




mo + mi -f m2 + W3 + ms + m6 + ms 

m^ + mj + m2 + ^3 + m4 + m5 + m^ + m^ + m^ 

m9 + mio + mi 1 + mi2 + mn + mi4 + mis 



These can be solved for mio to find the following equations. 

'^10 ~ ^8 + ^9 + ^10 ^1 1 
'^,0=^^12+^13+^14+^15 

If there are errors, the errors in the received codeword can be fixed 
through majority voting (if there are more I's than O's, then the bit is a 1). 
Generally, as described above, if the number of errors in the received code is 
10 less than 2 (i.e. 1 error or less), which is half of the dmin, then the encoded 
codeword can be correctly decoded. 

The internal structure of the decoding system of the present invention is 
different fi"om typical decoding schemes because high rate RM codes do not 
belong to the class of one-step majority decodable codes (such as LDPC codes). 
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Therefore, RM codes do not support the conventional message-passing 
algorithm (MP A). Instead, the decoder of the present invention operates on a 
graph defined by the RM code. 

By relaxing the orthogonality requirement, the code rate can be 
5 optimized to reach the code rate of LDPC codes, while maintaining a shorter 
code block length than is possible with LDPC codes. Thus, the high code rate 
can be achieved with shorter code blocks, thereby reducing or eliminating the 
large code-decoding delay characteristic of larger code blocks. 

Generally, a code can contain a large number of codewords. Each 
10 codeword is a binary number made up of ones and zeros. The minimum 
distance of a code corresponds to the codeword that has the fewest number of 
ones (I's). For example, in a code containing hundreds of codewords, if a 
codeword, having the fewest ones as compared with all the codewords contained 
in the code, has only four (4) ones, then the minimum distance for that code is 
15 four. This minimum distance factor can be used to compare Reed-Muller codes 
with the LDPC codes. 

As shown in FIG. 1, the code rates of Reed-Muller codes are plotted 
against the codeword length. The four plotted lines represent four different 
minimum distances. When the graph line showing a minimum distance of 32 
20 (d=32) is compared with the graph line showing a minimum distance of 4 (d=4), 
the trade-off between codeword length and code rate becomes apparent. 
Specifically, assuming a codeword length of 10,000 bits, the code rate of the 
code having a minimum distance of 32 is approximately 0.88, while the 
corresponding code rate for code having a minimum distance of 4 is 
25 approximately 0.99. 

In FIG. 2, the corresponding LDPC rate-length bounds are shown. 
Comparing FIGS. 1 and 2 using the same minimum distance and codeword 
lengths, RM codes can achieve higher code rates for a given length and 
minimum distance. For example, in FIG. 1, the code rate for a Reed-Muller 
30 code having a minimum distance of 8 at a codeword length of 1,000 bits is 
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approximately 0.945. By contrast, in FIG. 2, the code rate for an LDPC code 
having a minimum distance of 8 and a codeword length of 1,000 bits is 
approximately 0.88. Thus, the Reed-MuUer codes are shown to be capable of 
higher code rates for a given length and minimum distance than the LDPC 
5 codes. 

FIG. 3 illustrates a communication circuit 10 according to the present 
invention. The communication circuit 10 includes an RM-encoder 12, a partial- 
response channel 14, and a Reed-Muller partial response decoder 16 (RM-PR 
16). For simplicity, a transmission of a single codeword m is shown, though the 

10 same principle of operation holds for every message word transmitted. As 
shown, codeword m is input into the RM encoder 12, which generates an RM- 
encoded codeword x. RM-encoded codeword x is transmitted over the Partial- 
Response (PR) channel 14, which tends to introduce noise to the codeword x 
such that the received codeword y contains unknown errors. As shown, the 

15 received codeword y is input into the RM-PR decoder 16, which produces an 
output decoded codeword. 

The RM encoder 12 accepts a message word m of /:-binary digits (bits) 
and converts the message word m into a codeword x comprised of w-bits. The 
codeword x is then transmitted through a communication channel 14 (such as an 

20 optical fiber, a wireless conmiunication channel, or any other type of 
communication channel) or recording channel 14 (such as a magnetic hard disc 
drive, and the like). The channel 14 is equalized to a partial-response target. In 
other words, at the decoder 16, the impulse response of the channel 14 to a pre- 
defined transfer fimction is equalized to reduce the effect of intersymbol 

25 interference. 

When the received codeword >' arrives at the RM-PR decoder 16, the 
decoder 16 must reconstruct the transmitted message word m. The decoder 16 
ideally minimizes the number of bits where m and rh differ so as to minimize 
the number of bit errors. 
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FIG. 4 shows a modified version of the communication circuit 10 
of FIG. 3 with an exploded view of the RM-PR decoder 16. Specifically, FIG. 4 
illustrates a communication circuit 10 including an RM encoder 12, a PR 
channel 14, a RM-PR decoder 16 and an interleaver 18 (denoted in FIG. 4 by the 
5 symbol n"^) disposed between the RM encoder 12 and the PR channel 14. The 
interleaver 18 randomly re-orders the RM-encoded codeword x prior to passing 
the codeword x to the partial-response channel 14, The interleaver 18 is added 
to the first portion of the communication circuit 10 in order to highlight the 
position of the corresponding elements in the RM-PR decoder 16, which is 

10 presented in an expanded form to show the decoder 16 in greater detail. 

As shown, RM-PR decoder 16 has three stages A, B, and C. Stage A 
has a BCJR or SOVA device 20A, de-interleavers 22A (here shown as two 
interleavers denoted by to show that the two outputs are being "de- 
interleaved"), and a Reed-MuUer message passing device 24A. Stages B and C 

15 have corresponding BCJR or SOVA devices 20B and 20C, corresponding de- 
interleavers 22B and 22C, and corresponding Reed-Muller message passing 
devices 24B and 24C. Between stages A and B is an assembler 26A and an 
interleaver 28A, and between stages B and C is a corresponding assembler 26B 
and an interleaver 28B. Assemblers 26A and 26B and interleavers 28A and 28B 

20 perform a transitional function that converts the soft-decision data into the 
proper form for the next stage of the decoder 16, and are not necessary for the 
output of the final stage C of the decoder 16. 

Generally, the RM-PR decoder 16 uses soft-output information from the 
BCJR or SOVA devices 20 to generate a code bit likelihood vector that can be 

25 used on the received information y to decode y into the message m , which 
should approximately match original message m. At stage A, the code bit 
likelihood vector is equal to zero because there is no reliability information 
about the received data. At each subsequent stage B and C, the reliability vector 
is improved from the processes performed at the previous stage so that in the last 

30 stage, an improved reliability vector A{x) is used to evaluate the received 
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information j^. Each RM-PR decoder 16 can have any number of stages, and the 
last stage of the decoder will not have an assembler 26 or an interleaver 28. 
Generally, the number of stages in the decoder 16 is determined by the system 
designer and constitutes a trade-off between the complexity and cost of the 
5 system as compared to the performance of the system. For the purpose of this 
description, a three-stage decoder 16 is shown. 

As shown, the BCJR algorithm or the Soft-Output Viterbi algorithm is 
applied to the received codeword y by the BCJR or SOVA device 20A. The 
device 20A processes the received codeword y, producing code bit decisions on 

10 each bit of the codeword y as well as a code bit reliability vector A{x) for each 
code bit. The code bit decision and the code bit reliability vector are then passed 
through de-interleavers 22A (which are shown as two devices represented by 
in order to demonstrate that the de-interleaving process is performed on both 
outputs of the BCJR or SOVA device 20A) to produce a de-interleaved code bit 

15 decision Jc and a de-interleaved code bit reliability vector ju{x). 

It should be noted that the de-interleavers 22A, 22B, and 22C are 
necessary in this instance because the RM-encoded signal x is passed through an 
interleaver 18 prior to transmission. If the RM encoded signal x were not 
processed by the interleaver 18, the de-interleavers 22A,22B,22C would not be 

20 necessary to the decoder 1 6. 

Generally, the code bit decisions are represented in FIG. 4 as a vector x 
of length n, while the code bit reliabilities ju{x) are represented as vectors of the 
same length n. These two vectors are inputs to the Reed-MuUer Message 
Passing Algorithm block 24. For the detected vector and the corresponding 

25 reliabihty vector, the RM-MPA block 24 produces a decoded message bit 
and the corresponding reliability vector 

Though the decoding process could theoretically stop at this point, for 
optimum performance, one or more additional stages of processing must occur 
as described above. The decoded message bit m and the associated reliability 

30 vector ju{m) contain decoded bits and information bit reliabilities, respectively, 
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and not codeword reliabilities. The bits and information bit reliabilities must be 
converted back to code words and code word reliabilities. Assembler 26A 
restores the information bit reliabilities //(/w) into code word reliability vectors 
X, which are then passed through an interleaver 28A (71'') to the next BCJR or 

5 SOVA algorithm device 20B. The process is repeated n times (in this case, 
three times), and after n-stages, the last decoded message becomes the output of 
RM-PR decoder 24C. 

As shown, the BCJR or SOVA algorithm devices 20A, 20B, and 20C are 
identical. The BCJR or SOVA device 20A has no initial reliability vector A{x) 

10 associated with the received code word so the second input of the BCJR or 
SOVA device 20A is a reliability vector A{x) of value zero, providing no 
indication of reUability. Subsequent BCJR or SOVA devices 20B and 20C have 
improved reliability vectors A{x) at each subsequent stage, such that the final 
stage of processing has an idealized reliability vector A,{x) with which to 

15 process the code bits of the received code word y. Thus, the accuracy of the 
RM-PR decoder 16 improves with each iteration. 

Generally, the RM-MPA block 24 uses an RM code (r,m) that has the 
following parameters: length n=2"^, dimension , rate R=(n-k)/n, 
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and minimum distance 2"" ', where the parameters r>0 and m<l can be chosen 
arbitrarily. The notation 



25 
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is the "m-choose-j" function (the number of ways of selecting y different objects 
from a set of m different objects. The RM generator matrix can be written as 



G = 



wherein the sub-matrix Gj , 0<j<r, is of size 



m 



X n 



For the decoding of the RM codes, there exists an algorithm called the 
Reed algorithm, which is a maximum Ukelihood decoding algorithm when only 
code bit hard decisions are available. In the present invention, the code bit 
10 reliabilities are utilized instead of the code bit hard-decisions. 

Generally, in the Reed algorithm, the decoding is performed in r steps. 
In step j\ the message word x^^ of length ( J ) , corresponding to Gj (with indexes, 

such that 



is detected. For each of these bits, a set of 2^'^ linear equations can be written, 
involving all n bits of the received code word y. The positions of the code bits 
involved in the equations for calculating the s-th message bit, Xs^\ are given by 
20 the array Pg. 

In Ps, each column shows the locations of the code bits to be added 
together to give an estimation of the message bit Xs^^. This addition is moduIo-2 
addition. In the hard-coding version, the message bit is determined by a 
majority vote among all 2"^"^ estimations, (as described above), and the received 
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code vector is updated according to the relation y = y + x^^Gj, and then passed to 
the next decoding step (step j+1). 

In the present invention, instead of bit values, the method uses the log-bit 
likelihoods (LLR). 



LLR{bk) = log 



Probability{bk = -¥\\y) 
Probability{bk = -1 1 ;^)> 



where bk is the channel input and where y is the channel output. The log-bit 
likelihood of the s-th message bit from the l-th equation on the j-th step is 
10 calculated as follows, assuming all code bits are independent: 



where 5' ^ = signl /u 



X 

1 1 > 



(1) 
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and 



tanh 



(2) 



Where // 



I 



is the LLR of the expression for the A:-th message bit from the 



j-th equation in the j-ih. level. The LLR can be expressed as follows: 



20 





k 


< - tanh 


2 



(3) 
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The product and summation operations in equations (2) and (3) above are 
performed on the bit likelihoods of the code bits whose locations in the received 
codeword are determined by the /-th column of the matrix Pj. For the reduced 
complexity, (1), (2), and (3) maybe approximated as 



X 

I 




X 

I ) 



(4) 



The product and minimization operations in equation (4) are performed on the 
same bit likeHhoods as in equations (1) and (2). Next, the updated LLR of the k- 
10 the message bit in the /-th level is calculated by combining the likelihoods 
obtained from all 2""'^ equations. In other words 



m 



\<l<2"'~j 



(5) 



15 In the hard decoding version (Reed algorithm), a message bit is determined by a 
majority vote, and the received code vector is updated using the expression (2), 
and then passed to the next decoding step. In the soft version, prior to 
advancing to the next row of the decoder 16, the updated message bit likeHhoods 
must be converted to the code bit likelihoods. This conversion is performed 

20 based on the submatrix Gj, 

FIG. 5 illustrates an eleven layer illustration of the Reed graph designed 
to place the mathematical formulae of the instant invention into a graphical 
perspective. In this example, layer 1 represents a sixteen bit codeword received 
from the channel 14. In reality, the codeword could be much larger than 16 bits. 

25 In essence layer 1 represents the coded bits y received from the channel 

16. These equations are performed at layer 2 in FIG. 5 for reduced complexity 



Then, a soft-averaging, or rather an averaging of the LLRs is performed 
at layer 3. Then, we use submatrix G2 (below) to update code bit likelihoods 
using equations (6), (7), and (8), or (9) below. 

The positions of ones in the i-th column of Gj (below) indicate what 
5 message bits on the j-th level are used to calculate i-th code bit. For example, 
the nonzero elements in the 15-th column of below are 1, 2, and 3. This means 
that on the second level, the message bits m6 (=1+5), ml (=2+5) and m8 (=3+5) 
are used to calculate 15-th code bit. On the second level of encoding in this 
example, only the message bits from the location 6 to 1 1 are used. In a similar 
10 fashion we can find which message bits are used to compute i-th bit on the j-th 



Suppose that the nonzero positions of the l-th column of Gj are given by 
the set {li„At} where 



level. 
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and 




Then the conversion form message bit LLR to codebit LLR (// -> X) can be 



done as follows. 
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(6) 



J 




The equations (6), (7), and (8) may also be approximated as follows. 

25 
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This processing is performed at layer 4 in the Reed graph of FIG. 5. 

The updated LLR's for all of the codebits, which are to be used in the 
5 next decoding step, are found by applying equations (1),(2), and (3), or (4) 
above to the output of equation (8) and the output of the previous decoding level 
(/-I), which is the same as the input to the current decoding level (/). The final 
function of the RM-PR decoder 16 is the assembler 26A,26B for each stage 
respectively. This assembler function is performed by again applying equations 
10 (6), (7) and (8) to the LLR sequence of decoded message bits //(m), and this 
time the entire generator matrix G is used. The above equations (1-8) and 
subsequent updates codebit log likelihood reliabilities can be viewed as a 
message passing algorithm on a special type of graph called a "Reed graph". 

Then the process is repeated using the soft-decoded reliability vector 
15 derived from equation (11) above beginning with layer 6, which uses the 
original 16 bits and the rehability vector. 

Within the Reed graph, the connections between observation variables 
and hidden variables are different from those in factor graphs introduced with 
respect to one-step majority decodable code graphs in the prior art. The 
20 schedule of passing messages in the present invention is defined by the 
geometric structure of the Reed-MuUer codes. 

To illustrate the idea, we use the following example. Consider the 
(r,/w)=(2,4) RM code. The corresponding generator sub-matrices are given 
below. 

25 Go =[l 1 1 1 1 1 1 1 1 1 1 1 1 1 1 l] 
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5 From the four equations (from above), and the arrays of orthogonal parity check 
positions are: 

"»io = Co+c, +C2+C3 (10) 

/K,o = (11) 

(12) 
(13) 

It is possible to build an array or orthogonal parity checks for the message bit 
10 mio as shown below. Note that the first column of Pio is a set of indices from 
the first expression (10) above, and the other columns represent sets of indices 
from expressions 11-13. 

'0 4 8 12' 
1 5 9 13 
'° 2 6 10 14 
3 7 11 15_ 

15 

Similarly, for the other message bits (w, ) 
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10 


1 


3 
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13 


15 



0 18 9 

2 3 10 11 

4 5 12 13 

6 7 14 15 



P. = 
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12 
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5 
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12 
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10 


14 
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11 


15 



P. = 



0 14 5 

2 3 6 7 

8 9 12 13 

10 11 14 15 



0 2 4 6 

13 5 7 

8 10 12 14 

9 11 13 15 



^^4 = 



0 2 4 6 8 10 12 14 

1 3 5 7 9 11 13 15 



^3 = 



0 1 4 5 8 9 12 13 
2 3 6 7 10 11 14 15 



0 1 2 3 8 9 10 11 

4 5 6 7 2 3 4 5_ 

0 1 2 3 4 5 6 7 

8 9 10 11 12 13 14 15 



/>o=[0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] 



15 The Reed graph based on the above parity check arrays is illustrated in FIG. 5. 
The bipartite graph in the top portion of the figure corresponds to the orthogonal 
parity checks (squares) involving the second level message bits and code bits 
(j=2). The connections involving four parity checks in the top portion are 
defined in the array PIO. All other connections for the second level message 

20 bits m5,m6,...,m9 can be found in the corresponding arrays P5,P6,...,P9. 

In the first step of decoding, the code bit LLR (layer 1) are passed 
through the check nodes (layer 2) to the message variables (layer 3), using 
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equations (1),(2), and (3) or equation (4) above. After computing all the 
message bit likelihoods on the second level, submatrix G2 is used to update the 
code bit likelihoods using equations (5), (6), and (7) or equation (8) above. The 
first iteration step is finished when all message bit likelihoods are obtained and 
5 all code bit likelihoods are updated. Then, decoding proceeds to the next 
iteration. 

As shown in FIGS. 6 through 15, the performance of the above- 
described decoding technique was tested using two different ideal PR channels 
with additive white Gaussian noise (AWGN), a PR2 channel having an impulse 

10 response of {1 2 1} and an EPR4 channel having an impulse response of {1 1-1 
-1}. An ideal PR channel is a channel that has an impulse response that is 
exactly known without using an equalizer. In the figures, an ideal EPR4ML or 
ideal PR2ML refers to the appUcation of a maximum likelihood sequence 
detection (Viterbi algorithm) to the specified uncoded ideal channel (EPR3 or 

15 PR2). 

The system was tested using three different groups of RM codes 
according to their minimum distances (dmin) as shown in Table L 



TABLE 1: RM CODES USED FOR TESTING 



dmin 


Code 


16 


RM(5,9); RM(4,8); and RM(3,7) 


8 


RM(6,9); RM(5.8); RM(4,7); and RM(3,6) 


4 


RM(4,6)andRM(5,7) 



20 



Each of the codes in Table 1 has a code rate as shown in Table 2. 



TABLE 2: CODE RATES FOR RM CODES USED FOR TESTING. 



Code 


Code Rate (R) 


RM(5,9) 


0.746 
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RM(4,8) 


0.637 


RM(3,7) 


0.5 


RM(6,9) 


0.910 


RM(5,8) 


0.855 


RM(4,7) 


0.773 


RM(3,6) 


0.656 


RM(4,6) 


0.891 


RM(5,7) 


0.938 



As shown in FIGS. 6-15, the soft-iterative decoding system of the 
present invention was used to decode the RM codes of Table 1 using 10 

5 iterations in each instance. In other words, the decoder 16 used for the test 
included 10 rows of devices (20A,22A,24A,26A,28A or B-3-13-3-2,B-3-3 as 
shown in FIG. 4). In each instance, the coded sector size was 4096 bits, and 
many codewords were used to fill one complete sector. Of course, the number 
of codewords varied according to the RM code used. 

10 Generally, all transmissions (both inter-device and intra-device) are 

concerned with the signal-to-noise ration (SNR). The SNR and the noise 
variance are related by the following equation: 



15 



20 



5A« = 101ogio 



Es 



where Es is the average channel bit energy, cr^ is the variance of the noise 
channel, and R is the code rate. 

Regardless of the channel, hard Reed-MuUer decoding shows very poor 
Bit Error Rates (BER) relative to the soft-decoding technique of the present 
invention, especially with RM(6,9), RM(5,7), and RM(4,6) cases, where the 
code rates are relatively high. This result was expected because RM codes are 
known to perform well at low code rates. In general, it appears that code rates 
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above 0.9 do not perform efficiently for RM decoding, for hard-decision or soft- 
decision implementations. Additionally, both soft-decoding and hard-decoding 
techniques perform less than ideally in a low SNR region, a performance 
characteristic which appears to stem from error propagation within the decoding 
5 steps. In other words, from the internal structure of the multi-step decoding 
process of RM-codes, when an early decoding step results in an erroneous (hard 
or soft) decision, the error tends to propagate to the following steps. 

As shown in FIG. 6, as the codeword length (/) decreases, the total 
number of codewords in a sector increases. Correspondingly, as the codeword 

10 length decreases, the cross-over point (the point where the graph of the RM BER 
vs. SNR graph crosses the graph of the ideal EPR4ML chaimel) moves toward 
the low SNR region. In other words, the performance of the shorter codewords 
is noticeably better than the longer codewords; however, the soft-decoding 
system of the present invention outperforms the hard RM decoding technique by 

15 an average of 3dB for RM codes with dmin-8 and an ideal EPR4 channel with an 
impulse response of {11-1-1}. 

The improvement comes from the fact that within the system of the 
present invention error propagation is confined within one codeword. If there 
are many codewords in a given sector, error propagation from one erroneous 

20 codeword does not effect neighboring codewords. By contrast, if there is only 
one codeword in a sector, the error propagation effects all the bits in a the sector. 
As the SNR increases, the result of the limiting error propagation decreases, 
since there are fewer errors in any given sector. At the BER of 10-5 (1 error in 
100,000 bits), the soft-iterative decoding system shows an overall coding gain of 

25 4.0dB over the un-coded system and a coding gain of about 3.0 dB over the 
hard-decoded system. 

FIG. 7 illustrates the same trends a FIG. 6, though the gains of the soft- 
iterative decoding system are larger. The graph of FIG. 7 illustrates larger dmin 
and lower code rates than in FIG. 6. The slope of the BER curves in the 

30 "waterfall region" (the region where the graph line approaches vertical) are 
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steeper than those of FIG. 6. Finally, the BER of the RM hard«coded techniques 
also showed an improvement, though the soft-iterative decoding system shows a 
little over a 3dB code gain over the hard-coded system and a 4dB code gain over 
the un-coded system. 

5 FIGS. 8 and 9 show similar trends for the PR2 channel having an 

impulse response of {1 2 1}. Specifically, FIG. 8 illustrates almost a 5.5dB code 
gain for soft RM(3,6) relative to the un-coded system, and more than 4dB code 
gain relative to the hard RM(3,6) at a BER of 1 in 100,000. In this instance, the 
dmin equaled 8. 

10 In FIG. 9, the RM codes had a d^in of 16. The soft RM(3,7) decoding 

technique showed a 5.8 dB gain over the un-coded system, and more than a 4dB 
over the corresponding hard RM(3,7) system. 

FIG. 10 illustrates the role of the interleaver (n). Specifically, the 
interleaver distributes longer error events over the entire sector. Additionally, 

15 the interleaver appears to make burst errors into random erros. This effect 
appears to be important to the performance of the RM decoders. 

FIG. 1 1 shows the BERs at each iteration of the soft^iterative decoding 
for RM(3,7) code. Each iteration represents one row in FIG. 4 (as described 
above — ^including devices 20, 22, 242 26, and 28). The first four or five 

20 iterations appear to achieve the most significant gains. 

FIGS. 12 and 13 illustrate testing of high rate codes, confirming that the 
RM codes do not perform as well if the code rates are high. Even in this 
instance, the soft RM(4,6) and soft RM(5,7) decoder outperforms the hard RM 
system. 

25 FIGS. 14 and 15 compare the performance of RM codes with random 

LDPC codes at the code rates of 0.773 (low) and 0.938 (high), respectively. The 
LDPC codes serve as a reference because the random LDPC codes are known to 
achieve good results when decoded by the message passing algorithm. 

As shown in FIG. 14, the difference between the random LDPC and the 

30 soft-iterative RM decoder was about 1.5dB. The RM(4,7) code has a codeword 
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length of 128 bits, while the LDPC code has a codeword length of 4096 bits. 
The RM(4,7) code can be decoded relatively quickly because the codeword is 
short. Additionally, the structure can be much simpler than the LDPC decoder, 
in part, because the decoder structure can be used repeatedly in a sector to 
5 decode the entire sector. Thus, the soft-iterative decoder offers an alternative to 
the performance-complexity tradeoff between the random LDPC and the 
structure LDPC. 

FIG. 15 illustrates the RM(5,7) code relative to a random LDPC code 
having the same rate and codeword length. As shown, the soft Reed-MuUer 

10 code performs better than the un-coded system, but about 2.3dB worse than the 
LDPC code with n=4096 and a high code rate. 

It will be understood by a worker skilled in the art that the theory set out 
in detail above may be used to code information, regardless of the destination. 
Since the Reed-MuUer soft-iterative decoding system performs so well in terms 

15 of its BER relative to the SNR because the iterative process allows the decoder 
to occupy a relatively smaller circuit footprint, RM codes may be used to code 
information over physical wires, as well as between a magnetic read/write head 
and rotating disc. A worker skilled in the art will recognize that the iterative 
decoding system of the present invention has numerous applications. 

20 Although the present invention has been described with reference to 

preferred embodiments, workers skilled in the art will recognize that changes 
may be made in form and detail without departing from the spirit and scope of 
the invention. 



